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(54) Image file container 



(57) An image container file has at least first and 
second multimedia streams (MSs). The first MS in- 
cludes first image data representing an image. The sec- 
ond MS includes arbitrary data, which can for example, 
correspondto: adifferent representation ofthesame im- 
age; annotations to the first image data; second image 
data that together with the first image data form a new 
image with greater dynamic range, resolution, field of 
view or other attributes that can be derived from 
processing two or more independent images; or an ex- 
ecutablefile related to the first MS. The image container 
file can also include an extensible metadata to hold in- 
formation describing one or more multimedia streams 
of the image container file. Further, the image container 
file may include DRM information to provide information 
related to obtaining a license to access encrypted data 
or verifying the authenticity of encrypted or unencrypted 
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Description 

FIELD 

[0001 ] The present invention relates generally to data 
processing and, more particularly, to storage and crea- 
tion of image files. 

BACKGROUND 

[0002] In general, conventional image file formats 
provide for a single image to be stored in an image file. 
For example, a digital camera using such a conventional 
image file format would create a separate image file for 
each photograph taken. Thus, if a photographer used 
this camera to take several related images to form one 
overall photograph, each image would be stored in a 
separate image file, requiring the photographer or other 
userto manually organize and trackthe individual image 
files until they are integrated in a separate process. This 
manual task can be burdensome and prone to errors, 
especially if the photographer/user has a large number 
of images to manage. 

[0003] Another shortcoming of conventional image 
file formats is that they generally do not support digital 
rights management (DRM) features. Thus, an image 
owner generally does not have access to the same level 
of intellectual property protection that is widely available 
or video and audio content. 

[0004] An additional shortcoming of conventional im- 
age file formats is that they do not provide convenient 
integrated support for annotating images, for example, 
if a photographer or user wanted to provide an audio 
annotation for an individual image file or a group of re- 
lated images using conventional image file formats, the 
photographer/user would typically have to store the au- 
dio annotations in a separate file and manually manage 
the association between these two files. 

SUMMARY 

[0005] In accordance with aspects of the various de- 
scribed embodiments, an image container file has at 
least a first multimedia stream and a second multimedia 
stream. The image container file can contain more than 
two multimedia streams. The first multimedia stream in- 
cludes first image data representing an image. The sec- 
ond multimedia stream includes arbitrary data, typically 
related to the image of the first multimedia stream. For 
example, the arbitrary data can correspond to a different 
representation of the same image. The arbitrary data 
can also correspond to image, audio, video, graphics, 
text, date and time, location, web links, or animation an- 
notations to the first image data. The arbitrary data can 
also correspond to second image data that is related in 
some way to the image data in the first multimedia 
stream. For example, the second multimedia stream 
may one of multiple multimedia streams corresponding 



to a series of images captured in overtime, or a second 
image that can be combined with the first image data to 
form a new image with greater overall quality, such as 
greater dynamic range, pixel resolution, or field of view, 
s The arbitrary data can also correspond to an application 
(i.e., an executable file) that can be used to view and/or 
process the first image data. 

[0006] In another aspect, the image container file can 
also include an extensible metadata objectto hold infor- 

10 mation describing one or more image representations 
stored in the image container file. The metadata can in- 
clude information related to the image (or audio or video 
clip) such as the title; the creator; subject; a description, 
the publisher; contributor, date, format, language, and 

is other types of information that may be desirable de- 
pending on the application. Metadata can also make ref- 
erence to the other streams in the image file container 
on a per-container or per-stream basis. 
[0007] In still another aspect, the image container file 

20 may store one or more image representations and/or 
other multimedia streams in encrypted format. In this 
case, the image container file will include digital rights 
information. For example, the digital rights information 
may be related to obtaining a license to access encrypt- 

25 ed data contained in the image container file. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0008] Non-limiting and non-exhaustive embodi- 
30 ments of the present invention are described with refer- 
ence to the following figures, wherein like reference nu- 
merals refer to like parts throughout the various views 
unless otherwise specified. 

[0009] FIG. 1 is a block diagram illustrating a system 
35 using an image container file, according to one embod- 
iment. 

[0010] FIG. 2 is a flow diagram illustrating the forma- 
tion of an image containerfile, according to one embod- 
iment. 

40 [0011] FIG. 3 is a block diagram illustrating compo- 
nents of an image container file, according to a first em- 
bodiment. 

[0012] FIG. 4 is a block diagram illustrating compo- 
nents of an image containerfile, according to a second 
45 embodiment. 

[0013] FIG. 5 is a block diagram illustrating compo- 
nents of an image containerfile, according to a third em- 
bodiment. 

[0014] FIG. 6 is a block diagram illustrating an exem- 
50 plary computing environment suitable for forming or us- 
ing an image container file, according to one embodi- 
ment. 

DETAILED DESCRIPTION 

55 

[0015] FIG. 1 illustrates a simplified system 100 using 
an image container file, according to one embodiment. 
In this embodiment, system 100 includes a device 102 
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and a platform 104. In atypical application, device 102 
is an image generating device such as, for example, a 
digital camera, scanner, mobile telephone (with cam- 
era), a personal computer with camera, personal digital 
assistant (PDA) with camera, television set-top box with 
still-image capture, video tape player with still-image 
capture, digital versatile disc (DVD) player with still-im- 
age capture, or other suitable image sensing/capturing 
device or apparatus. Platform 104 is typically imple- 
mented with a personal computer, storage device (e.g., 
a hard drive, compact disk, digital versatile disc (DVD), 
tape, network storage, or other storage media), printer, 
or other suitable device or apparatus for storing or view- 
ing images. Other embodiments of system 1 00 may be 
implemented using multiple devices similar to device 
102, or multiple platforms similar to platform 104, or a 
combination of such devices and platforms. In this em- 
bodiment, the image container file can be transferred 
between device(s) and/or platform(s) interchangeably. 
[0016] In this embodiment, device 1 02 includes an im- 
age container file generator 110, a data store 114, and 
an interface 1 1 6 to a communications medium. Platform 
104, in this embodiment, includes an image container 
file reader 120, a datastore 124 and an interface 126. In 
other embodiments (e.g., when platform 104 is used 
mainly as storage), image file reader 120 may be omit- 
ted. 

[0017] Device 102 can send an image container file 
106 (generated by image container file generator 110 
and slored in dalaslore 1 1 4) lo platform 1 04 via interface 
1 1 6 and a link 1 08. By way of example, link 1 08 can be 
a direct wired connection, a wireless connection, a net- 
work (e.g., a local area network, the Internet, telephone 
system, etc.), direct transportation of removable media 
from device 1 02 to platform 1 04 (removable disk media, 
flash memory media, CD-ROM, DVD-RW or DVD+RW), 
etc. Platform 104 receives image container file 106 via 
interface 126 and stores it in datastore 124. Data con- 
tained in image containerfile 1 06 can then be accessed 
via imagecontainerfile reader 1 20, as desired by a user. 
[0018] Unlike systems that use conventional image 
file formats, system 100 uses image containerfile 106 
to provide a flexible, extensible, backward-compatible 
mechanism to store images, image annotations, digital 
rights management (DRM) information and other arbi- 
trary information in a self-describing manner. Embodi- 
ments of image containerfile 106 are described in more 
detail below in conjunction with FIGS. 3-6. 
[0019] FIG. 2 illustrates the formation of image con- 
tainer file 106 (FIG. 1), according to one embodiment. 
Referring to FIGS. 1 and 2, this embodiment of device 
102 forms an image containerfile as follows. In a block 
202, device 102 collects image data. In one embodi- 
ment, the image data is collected from an image sensor 
(not shown). For example, the sensor may be a charge- 
coupled device (CCD) of a digital camera. The image 
data is then stored in datastore 114. In some embodi- 
ments, the image data may be processed by the device 



and then stored in datastore 114. The image data may 
be raw sensor data; uncompressed image data (i.e., raw 
data that is processed into an uncompressed represen- 
tation of the image); compressed image data (e.g., ac- 

s cording to the Joint Photographic Experts Group (JPEG) 
or other suitable compression format). The format of the 
image data generally depends on the processing per- 
formed by the device, and as will be described below, 
image container file 1 06 is designed to accept any for- 

io mat. 

[0020] In a block 204, device 102 stores the image 
data from block 202 as a multimedia stream in image 
containerfile 106. As used herein, a multimedia stream 
in this context typically refers to (but is not limited to) a 

'5 single image or information used to represent a single 
image, a portion of recorded video, a portion of recorded 
audio, or an executable object or application. In one em- 
bodiment, image container file generator 110 obtains 
the image data from datastore 114 and stores informa- 

20 tion related to the image data and the overall organiza- 
tion of image container file in a header portion of image 
containerfile 106. Image file generator 110 also stores 
at least some of the image data (e.g., pixel data) in a 
data portion of image container file 1 06. In this embod- 

25 iment, the image container file generator may also store 
location information forthe image data stored in the data 
portion in an index portion of the image containerfile. 
For example, this location information may include an 
offset from a preselected point of the image container 

30 file. In some embodiments, the index object may be 
omitted (e.g., when the image containerfile contains on- 
ly image data representing a single image). The header, 
data, and index portions form components of this em- 
bodiment of image containerfile 106 (e.g., see FIG. 3 

35 described below). In other embodiments, image con- 
tainer file 106 may include other components. For ex- 
ample, some additional components are described be- 
low in conjunction with FIGS. 4 and 5. 
[0021] In decision block 206, device 102 determines 

40 whether additional information is to be associated with 
the image data collected in block 202. For example, de- 
vice 102 may include a microphone and appropriate 
processing components for recording audio segments. 
The user can make an audio annotation to the image 

45 data collected in block 202 by activating the audio re- 
cording -components and speaking into the micro- 
phone. In this embodiment, image containerfile gener- 
ator 110 is configured to detect when the audio record- 
ing feature is activated for annotating the image data 

so collected in block 202. 

[0022] Device 102 may include other features that 
generate information to be associated with the image 
data collected in block 202. Examples of such features 
include (but are not limited to): (a) automatic generation 

55 of proof or thumbnail size images and full scale repre- 
sentations of a single image; (b) generation of a se- 
quence of individual images that will later be processed 
to create a panoramic image; (c) generation of a single 
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image having multiple representations for different ex- 
posure settings, white balance settings, compression 
settings, pixel resolutions, color space {e.g., a color 
space for printing and a different color space for display 
using a monitor), field of view, color context (described 
further below); (d) generation of other annotations (e.g., 
video, graphic, text annotations); and (e) appending ex- 
ecutable applications (e.g., an application needed to in- 
terpret raw image data, orto decode a proprietary com- 
pression format). In one embodiment, streams of video 
and audio data are added to image container file 106 in 
a manner substantially similar to the advanced systems 
format (ASF). Each additional piece of data is added an 
additional multimedia stream with header information 
about the data stored in the header portion and the data 
itself stored in the data portion of image container file 
106. 

[0023] As used herein, a color space is a mathemat- 
ical space within which color values can be defined by 
a (typically) small number of color coordinates. For ex- 
ample, the RGB color space uses three coordinates (la- 
beled R, G and B) to specify a color and the CMYK color 
space uses four different coordinates (C. M , Y and K) to 
specify a color. The color values in these two spaces 
behave differently. RGB is typically used to describe 
light, which is additive, and CMYK is typically used to 
describe ink, which is subtractive. Converting color val- 
ues from one color space to another can be done, but 
in some cases [his will degrade the color values. 
[0024] As used herein, a color context defines what 
the color coordinates actually mean, with reference to 
some objective standard. For example, several devices 
can use the RGB color space, but the same RGB color 
values displayed on each of these devices might not 
look the same (even under the same viewing condi- 
tions). This is caused because each of the devices is 
using a different color context. 
[0025] If in decision block 206 image container file 
generator 1 1 0 determines that no additional information 
is to be associated with the image data collected in block 
202, the image container file is complete and the oper- 
ational flow in forming an image container file termi- 
nates. Otherwise, the operational flow proceeds to a 
block 208. 

[0026] Returning to FIG. 2, in block 208, device 104 
forms another multimedia stream. If the additional infor- 
mation is image data for another representation of the 
image, image container file generator 110 performs 
block 208 in substantially the same manner as previous- 
ly described for blocks 202 and 204. That is, in this em- 
bodiment, image container file generator 1 1 0 generates 
header information and stores it in the header portion, 
stores at least some of the image data [e.g. pixel data) 
to the data portion and stores location information for 
this new image information in the index portion. If the 
additional information is not image data, image contain- 
er file generator 1 1 0 will perform substantially the same 
operations, but the header information will include infor- 
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mation specific to the additional information in the head- 
er portion of image container file 106. For example, the 
header information could include indicating whether the 
additional information is audio data, video data, an ex- 

s ecutable application, etc. The operational flow then re- 
turns to decision block 206 to determine if another mul- 
timedia stream should be formed. 
[0027] FIG. 3 illustrates components of image con- 
tainer file 106 (FIG. 1), according to a first embodiment. 

io In this embodiment, image container file 1 06 includes a 
header portion 302, a data portion 304 and an index por- 
tion 306. Header portion 302 includes header informa- 
tion for each multimedia stream contained in image con- 
tainer file 106. In this illustrative image container file, 

is header portion 302 includes header information 31 2^ 
through 31 2 N for a first multimedia stream through an 
Nth multimedia stream, respectively. Header informa- 
tion includes information such as, for example, the basic 
properties of the multimedia stream, language present 

20 in the multimedia stream, properties of the index infor- 
mation stored in index portion 306 for the multimedia 
stream, padding information that specifies padding in 
the header information. Header information may also in- 
clude information identifying the compression algorithm 

25 forthismultimediastream, script commands embedded 
in the header information, marker information identifying 
markers embedded in the data (stored in data portion 
304) for the multimedia stream. In other embodiments, 
header information may include information about other 

30 properties of the multimedia stream. In one embodi- 
ment, header information is formed in a manner similar 
(but simplified) to that of the aforementioned ASF for- 
mat. The above description for header portion 302 is il- 
lustrative of a particular embodiment; however, in other 

35 embodiments, header portion 302 can be formed using 
any suitable format [e.g., different header information 
formats, definitions etc.). 

[0028] Data portion 304, in this example, includes da- 
ta31 4-, through 31 4 N forthe first through Mh multimedia 

40 streams, respectively. In one illustrative embodiment, 
packets are used to store data in data portion 306. Al- 
though a packet data storage embodiment is described 
in more detail below, in other embodiments different ap- 
proaches may be used to store data in data portion 304. 

45 in this illustrative embodiment, the packets can have a 
variable size up to four gigabytes since images can be 
quite large. In other embodiments, the packets may be 
of fixed size or of different size. The packets represent- 
ing data from different streams may be optionally inter- 

50 leaved in some embodiments. That is, a packet from 
stream A may be followed by a packet from stream 6 
and then additional packets from stream A, allowing de- 
vice 102 to generate the information in any order. Fur- 
ther, a packet may contain data from more than one mul- 

55 timedia stream. Still further, multiple packets may be 
used to store the data of a single multimedia stream. 
This packet approach provides flexibility in storing mul- 
timedia data in data portion 304. As previously de- 
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scribed, the data contained in data portion 304 may be, 
for example, image data (raw, uncompressed and/or 
compressed). Further data portion 304 may contain im- 
age data representing multiple representations of a sin- 
gle image, image data for multiple images to be com- 
bined into a single image. Still further, data portion 304 
may include audio data, video data, graphics, ortext da- 
ta to annotate image data, and/or executable program 
code to operate on or process image data contained in 
the data object. 

[0029] Index portion 306 includes index 31 6 1 through 
index 31 6 N for the first through Mh multimedia streams, 
respectively. As previously mentioned, the index infor- 
mation is used to locate desired portions of data in the 
data object. In one embodiment, index object 306 issub- 
stantiany similar to the index object used in the afore- 
mentioned ASF format. In other embodiments, other 
suitable indexing mechanisms may be used. 
[0030] FIG. 4 illustrates components of image con- 
tainer file 106 (FIG. 1), according to a second embodi- 
ment. This embodiment is substantially similar to the 
embodiment of FIG. 3, except that this embodiment in- 
cludes a metadata portion 400 in header portion 302, 
Metadata portion 400 provides a mechanism for meta- 
data to be associated with all of the multimedia streams 
of image container file 1 06, or with one or more partic- 
ular multimedia stream(s) of image containerfile 106. In 
addition, metadata portion 400 allows an end user of im- 
age file container 106 to access the metadata without 
having to process data portion 304 and index portion 
306. Still further, metadata portion 400 provides an ex- 
tensible metadata formattoprovideflexibility in adapting 
image container file 1 06 for other applications. 
[0031] In one embodiment, metadata portion 400 al- 
lows for one or more namespaces to be defined, with 
individual metadata items in each namespace including 
a self-describing name field and an associated value 
field. In one embodiment, this metadata content is 
mapped into extensible markup language (XML). In one 
embodiment, a namespace may contain metadata 
items having definitions that are substantially similar to 
those in the Dublin Core Metadata Initiative (DCMI) 
Metadata Terms issued March 4, 2003 and the DCMI 
Type Vocabulary issued February 12, 2003. Alternative 
or additional metadata namespaces may also include 
definitions substantially similar to those corresponding 
to other established metadata standards. For example, 
these other formats include the exchangeable Image 
File Format for Digital Still Cameras (EXIF) Version 2.2, 
April 2002, by the Japan Electronic Industry Develop- 
ment Association (JEIDA) and/or the Information Inter- 
change Model (I IM) version 4.1 issued July 1999 by the 
International Press Telecommunications Council 
(IPTC). Other standardized or application-specific self- 
describing namespace may also be included in metada- 
ta portion 400. 

[0032] Metadata portion 400 can include information 
related to the image (or audio or video clip) such as the 



title; the creator; subject; a description, the publisher; 
contributor, date, format, language, and other types of 
information that may be desirable depending on the ap- 
plication. Because metadata portion 400 is extensible, 
s applications and/or users can define their own metadata 
and such extensions can be used simultaneously within 
a single container and metadata portion without conflict. 
[0033] FIG. 5 illustrates components of image con- 
tainerfile 1 06 (FIG. 1), according to a third embodiment. 
10 This embodiment is substantially similar to the embod- 
iment of FIG. 4, except that this embodiment includes a 
digital rights management (DRM) portion 500 in header 
portion 302 and encrypted data 51 4 1 through 51 4 N for 
the first through Wth multimedia streams, respectively 
'5 (instead of data 31 4^ through 31 4 N as in the embodi- 
ment of FIG. 4). In one embodiment, DRM portion 500 
includes information related to accessing encrypted da- 
ta 51 4.| -51 4 N . For example, DRM portion 500 may in- 
clude the universal resource locator (URL) of a license 
20 server (i.e., from which users may obtain a license to 
use the image and other data contained in image con- 
tainerfile 1 06). The license can include a key for decryp- 
tion of encrypted data 51 4., -51 4 N . The DRM information 
can also be related to verifying the authenticity the im- 
25 age data. In other embodiments, the encryption can be 
applied on a per multimedia stream basis. 
[0034] FIG. 6 illustrates a general computer environ- 
ment 600, which can be used to implement the tech- 
niques described herein. For example, device 102 and 
30 platform 1 04 may each include a computer environment 
substantially similar to general computer environment 
600. The computer environment 600 is only one exam- 
ple of a computing environment and is not intended to 
suggest any limitation as to the scope of use or func- 
35 tionality of the computer and network architectures. Nei- 
ther should the computer environment 600 be interpret- 
ed as having any dependency or requirement relating 
to any one or combination of components illustrated in 
the example computer environment 600. 
40 [0035] With reference to FIG. 6, one exemplary sys- 
tem for implementing the invention includes a comput- 
ing device, such as computing device 600. In a very ba- 
sic configuration, computing device 600 typically in- 
cludes at least one processing unit 602 and system 
45 memory 604. Depending on the exact configuration and 
type of computing device, system memory 604 may be 
volatile (such as RAM), non-volatile (such as ROM, flash 
memory, etc.) or some combination of the two. System 
memory 604 typically includes an operating system 605, 
so one or more program modules 606, and may include 
program data 607. This basic configuration of comput- 
ing device 600 is illustrated in FIG 6 by those compo- 
nents within dashed line 608. 

[0036] Computing device 600 may have additional 
55 features orfunctionality. Forexample, computing device 
600 may also include additional data storage devices 
(removable and/or non-removable) such as, for exam- 
ple, magnetic disks, optical disks, or tape. Such addi- 
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tional storage is illustrated in FIG. 6 by removable stor- 
age 609 and non-removable storage 610. Computer 
storage media may include volatile and nonvolatile, re- 
movable and non-removable media implemented in any 
method or technology for storage of information, such s 
as computer readable instructions, data structures, pro- 
gram modules, or other data. System memory 604, re- 
movable storage 609 and non-removable storage 610 
are all examples of computer storage media. Computer 
storage media includes, but is not limited to, RAM , ROM, to 
EEPROM, flash memory or other memory technology, 
CD-ROM, digital versatile disks ("DVD") or other optical 
storage, magnetic cassettes, magnetic tape, magnetic 
disk storage or other magnetic storage devices, or any 
other medium which can be used to store the desired ts 
information and which can be accessed by computing 
device 600. Any such computer storage media may be 
part of device 600. Computing device 600 may also 
have input device(s) 612 such as keyboard 622, mouse 
623, pen, voice input device, touch input device, scan- 20 
ner, etc. Output device(s) 61 4 such as a display, speak- 
ers, printer, etc. may also be included. These devices 
are well known in the art and need not be discussed at 
length here. 

[0037] Computing device 600 may also contain com- 25 
munication connections 616 that allow the device to 
communicate with other computing devices 618, such 
as over a network. Communication connections 616 are 
one example of communication media. Communication 
media may Lypically be embodied by computer readable 30 
inslruclions, dala slruclures, program modules, orolher 
data in a modulated data signal, such as a carrier wave 
or other transport mechanism, and includes any infor- 
mation delivery media. The term "modulated data sig- 
nal" means a signal that has one or more of its charac- 35 
teristics set or changed in such a manner as to encode 
information in the signal. By way of example, and not 
limitation, communication media includes wired media 
such as a wired network or direct-wired connection, and 
wireless media such as acoustic, RF, infrared and other 40 
wireless media. The term computer readable media as 
used herein includes both storage media and commu- 
nication media. 

[0038] Various modules and techniques may be de- 
scribed herein in the general context of computer-exe- 45 
cutable instructions, such as program modules, execut- 
ed by one or more computers or other devices. Gener- 
ally, program modules include routines, programs, ob- 
jects, components, data structures, etc. for performing 
particular tasks or implement particular abstract data so 
types. These program modules and the like may be ex- 
ecuted as native code or may be downloaded and exe- 
cuted, such as in a virtual machine or other just-in-time 
compilation execution environment. Typically, the func- 
tionality of the program modules may be combined or 55 
distributed as desired in various embodiments. 
[0039] Reference has been made throughout this 
specification to "one embodiment," "an embodiment," or 
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"an example embodiment" meaning that a particular de- 
scribed feature, structure, or characteristic is included 
in at least one embodiment of the present invention. 
Thus, usage of such phrases may refer to more than 
just one embodiment. Furthermore, the described fea- 
tures, structures, or characteristics may be combined in 
any suitable manner in one or more embodiments. 
[0040] One skilled in the relevant art may recognize, 
however, that the invention may be practiced without 
one or more of the specific details, or with other meth- 
ods, resources, materials, etc. In other instances, well 
known structures, resources, or operations have not 
been shown or described in detail merely to avoid ob- 
scuring aspects of the invention. 
[0041] While example embodiments and applications 
of the present invention have been illustrated and de- 
scribed, it is to be understood that the invention is not 
limited to the precise configuration and resources de- 
scribed above. Various modifications, changes, and var- 
iations apparent to those skilled in the art may be made 
in the arrangement, operation, and details of the meth- 
ods and systems of the present invention disclosed 
herein without departing from the scope of the claimed 



Claims 

1 . A computer-readable medium encoded with a data 
structure for use in an image file, the data structure 
comprising 

a data portion to includefirst image data related 
to a first mu Itimedia stream, and a first arbitrary 
data related to a second multimedia stream; 
and 

a header portion to include a first header object 
comprising information related to the first mul- 
timedia stream, and a second header object 
comprising information related to the second 
data multimedia stream. 

2. The computer-readable medium of claim 1 .wherein 
the second multimedia stream comprises second 
image data, the first and second image data provid- 
ing different representations of a single image. 

3. The computer-readable medium of claim 1 .wherein 
the data portion includes data related to three or 
more multimedia streams. 

4. The computer-readable medium of claim 2, wherein 
the first and second image data comprise com- 
pressed and uncompressed image data, respec- 
tively. 

5. The computer-readable medium of claim 2, wherein 
the first image data is derived from a first camera 
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setting and the second image data is derived from 
a second camera setting. 

6. The computer-readable medium of claim 2, wherein 
the first image data represents the single image 
having a first pixel resolution , and the second image 
data represents the single image having a second 
pixel resolution different from the first pixel resolu- 
tion. 

7. The computer-readable medium of claim 2, wherein 
the first image data represents the single image 
having a first pixel format, and the second image 
data represents the single image having a second 
pixel format different from the first pixel format, 
wherein a pixel format includes one or more com- 
ponents, component ordering, and component nu- 
meric formats. 

8. The computer-readable medium of claim 2, wherein 
the first image data is derived using a first color 
space and second image data is derived from a sec- 
ond color space. 

9. The computer-readable medium of claim 2, wherein 
the first image data is derived using a first color con- 
text and second image data is derived from a sec- 
ond color context. 

1 0. The computer-readable medium of claim 2, wherein 
the first image data represents the single image 
having a first field of view, and the second image 
data represents the single image having a second 
field of view.. 

1 1 . The computer-readable medium of claim 2, wherein 
the first image data comprises raw image sensor 
data. 

1 2. The computer-readable medium of claim 1 , wherein 
the second multimedia stream includes data repre- 
senting an annotation of an image represented by 
the first image data. 

13. The computer-readable medium of claim 12, where- 
in the second multimedia stream comprises audio 
data. 

14. The computer-readable medium of claim 12, where- 
in the second multimedia stream comprises video 
data. 

15. The computer-readable medium of claim 1, wherein 
the second multimedia stream comprises an exe- 
cutable component. 

16. The computer-readable medium of claim 1, wherein 
the second multimedia stream comprises second 



image data, wherein data from the first image data 
and data from the second image data to be com- 
bined to represent an image that is larger than indi- 
vidual images represented by the first and second 
s image data. 

17. The computer-readable medium of claim 1 , wherein 
the second multimedia stream comprises second 
image data, wherein data from the first image data 
10 and data from the second image data to be com- 
bined to represent an image that is of higher quality 
than individual images represented by the first and 
second image data. 

's 18. The computer-readable medium ofclaim 1 .wherein 
the data structure further comprises metadata. 

19. The computer-readable medium ofclaim 1 .wherein 
the data structure further comprises an index por- 

20 tion to contain information related to a location of 
data stored in the data portion. 

20. The computer-readable medium ofclaim 1 , wherein 
data stored in the data portion is encrypted. 

25 

21. The computer-readable medium ofclaim 1 , wherein 
the header portion further comprises digital rights 
management information. 

30 22. The computer-readable medium ofclaim 21, where- 
in the digital righls management informalion con- 
tains information related to obtaining a license to ac- 
cess the first image data, 

35 23. Thecomputer-readablemediumofclaim21, where- 
in the digital rights management information con- 
tains information related to obtaining a license to 
verify the authenticity of the first image data. 

40 24. The computer-readable medium of claim 1, wherein 
the multimedia data structure is compatible with ad- 
vanced systems format (ASF). 

25. The computer-readable medium ofclaim 1 , wherein 
45 the second multimedia stream comprises image, 

audio, video, graphics, text, date and time, location, 
web links, or animation data. 

26. A method for forming an image container file, corn- 
so prising: 

collecting image data; 

forming a first multimedia stream in the image 
container file, the first multimedia stream in- 
55 eluding a first image data derived from the col- 

lected image data and a first header object hav- 
ing information related to the first image data; 
collecting arbitrary data; and 
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forming a second multimedia stream in the im- 
age container file, the second multimedia 
stream including first arbitrary data derived 
from the collected arbitrary data and a second 
header object having information related to the 
first arbitrary data. 

27. The method of claim 26, wherein the first arbitrary 
data comprises second image data, the first and 
second image data providing different representa- 
tions of a single image. 

28. The method of claim 27, wherein the first and sec- 
ond image data comprise compressed and uncom- 
pressed image data, respectively. 

29. The method of claim 27, wherein the first image da- 
ta is derived from a first camera setting and the sec- 
ond image data is derived from a second camera 
setting. 

30. The method of claim 27, wherein the first image da- 
ta represents the single image having a first pixel 
resolution, and the second image data represents 
the single image having a second pixel resolution 
different from the first pixel resolution. 

31 . The method of claim 27, wherein the first image da- 
ta represents the single image having a first pixel 
format, and the second image data represents the 
single image having a second pixel format different 
from the first pixel format. 

32. The method of claim 27, wherein the first image da- 
ta is derived using a first color space and second 
image data is derived from a second color space. 

33. The method of claim 27, wherein the first image da- 
ta is derived using a first color context and second 
image data is derived from a second color context. 

34. The method of claim 26, wherein the first image- 
data comprises raw image sensor data. 

35. The method of claim 26, wherein the first arbitrary 
data comprises data representing an annotation of 
an image represented by the first image data. 

36. The method of claim 35, wherein the first arbitrary 
data comprises audio, video, graphics, text, date 
and time, location, web links, or animation data. 

37. The method of claim 26, wherein the first arbitrary 
data comprises an executable component. 

38. The method of claim 26, wherein the first arbitrary 
data comprises second image data, wherein data 
from the first image data and data from the second 



image data to be combined to represent an image 
that is larger than individual images represented by 
the first and second image data. 

s 39. The method of claim 26, wherein the first arbitrary 
data comprises second image data, wherein data 
from the first image data and data from the second 
image data to be combined to represent an image 
that is of higher quality than individual images rep- 

10 resented by the first and second image data. 

40. The method of claim 26, further comprising adding 
metadata to the image container file. 

'5 41. The method of claim 26, further comprising forming 
an index portion to contain information related to a 
location of data stored in the image container file. 

42. The method of claim 26, further comprising storing 
20 digital rights management information in the image 

container file. 

43. The method of claim 42, wherein the digital rights 
management information contains information re- 

25 latedto obtaining a license to access the first image 
data. 

44. The method of claim 42, wherein the digital rights 
management information contains information re- 

30 lated to verifying the authenticity the first image da- 



45. The method of claim 26, wherein the image file con- 
tainer contains encrypted data. 

35 

46. The method of claim 26, wherein the multimedia da- 
ta structure is compatible with advanced systems 
format (ASF). 

40 47. The method of claim 26, further comprising forming 
a plurality of multimedia streams in the image con- 
tainerf ile, the plurality of multimedia streams includ- 
ing the second multimedia stream, wherein another 
multimedia stream in the plurality of multimedia 

45 streams includes second arbitrary data and a third 
header object having information related to the sec- 
ond arbitrary data. 

48. A system for storing image data, the system-com- 
so prising: 

an image data receiver; and 
an image file generator to form an image con- 
tainer file having a plurality of multimedia 
55 streams, the plurality of multimedia streams in- 

cluding a first multimedia stream and a second 
multimediastream, wherein the first multimedia 
stream to include first image data derived from 
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image data received by the image data receiv- 
er, and the second multimedia stream to in- 
clude arbitrary data. 

49. The system of claim 48, wherein the arbitrary data 
comprises second image data, the first and second 
image data providing different representations of a 
single image. 

50. The system of claim 48, wherein the arbitrary data 
comprises data representing an annotation of an 
image represented by the first image data. 

51. The system of claim 50, wherein the arbitrary data 
comprises audio, video, graphics, text, date and 
time, location, web links, or animation data. 

52. The system of claim 48, wherein the arbitrary data 
comprises an executable component. 

53. The system of claim 48, wherein the arbitrary data 
comprises second image data, wherein data from 
thefirst image data and datafrom the second image 
data to be combined to represent an image that is 
larger than individual images represented by the 
first and second image data. 

54. The system of claim 48, wherein the arbitrary data 
comprises second image data, wherein data from 
Lhefirslimage dala anddalafrom Ihesecond image 
data to be combined to represent an image that is 
of higherquality than individual images represented 
by the first and second image data. 

55. The system of claim 48, wherein the image file gen- 
erator is further to add metadata to the image con- 
tainer file. 

56. The system of claim 48, wherein the image file gen- 
erator is further to add index information related to 
locations of first image data and the first arbitrary 
data within the image container file. 

57. The system of claim 48, wherein the image contain- 
er file contains encrypted data. 

58. The system of claim 48, wherein the image file gen- 
erator is further to store digital rights management 
information in the image container file. 

59. The system of claim 58, wherein the digital rights 
management information contains information re- 
lated to obtaining a license to access thefirst image 
data. 

60. The system of claim 58, wherein the digital rights 
management information contains information re- 
lated to verifying the authenticity of the first image 



data, 

61 . The system of claim 48, wherein the image contain- 
er file can be accessed using a multimedia viewer. 

5 

62. The system of claim 61 , wherein the multimedia 
viewer comprises a viewer than can view advanced 
systems format (ASF) files. 

w 63. A computer-readable medium having components 
as recited in claim 48. 

64. A system for storing image data, the system com- 
prising: 

means for collecting image data; and 
means for generating an image container file 
that includes a plurality of multimedia streams, 
the plurality of multimedia streams including a 

20 first multimedia stream and a second multime- 

dia stream, wherein the first multimedia stream 
includes first image data derived from image 
data received by the image data receiver, and 
the second multimedia stream includes arbi- 

25 trary data. 

65. The system of claim 64, wherein the arbitrary data 
comprises second image data, the first and second 
image data providing different representations of a 

30 single image. 

66. The system of claim 64, wherein the arbitrary data 
comprises data representing an annotation of an 
image represented by the first image data. 

35 

67. The system of claim 66, wherein the arbitrary data 
comprises audio, video, graphics, text, date and 
time, location, web links, or animation data. 

40 68. The system of claim 64, wherein the means for gen- 
erating selectively encrypts data contained in the 
image container file. 

69. The system of claim 64, wherein the arbitrary data 
45 comprises an executable component. 

70. The system of claim 64, wherein the means for gen- 
erating includes means for adding metadata to the 
image container file. 

50 

71 . The system of claim 64, wherein the means for gen- 
erating includes means forstoring index information 
related to locations of the first image data and the 
first arbitrary data within the image container file. 

55 

72. The system of claim 64, further comprising means 
forstoring digital rights management information in 
the image container file. 
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73. The system of claim 72, wherein the digital rights 
management information contains information re- 
lated to obtaining a license to access the first image 
data. 

5 

74. The system of claim 72, wherein the digital rights 
management information contains information re- 
lated to verifying the authenticity of the first image 
data. 

75. A computer-readable medium having components 
as recited in claim 64. 

76. The computer-readable medium of claim 2, wherein 

the camera settings comprises exposure settings. is 

77. The computer-readable medium of claim 2, wherein 
the camera settings comprises white balance set- 
tings. 

20 

78. The method of claim 25, wherein the camera set- 
tings comprises exposure settings. 

79. The method of claim 25, wherein the camera set- 
tings comprises white balance settings. 2s 
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